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RELATED APPLICATION DATA 
The present application is related to U.S. Patent Application Serial No. 
09/490,761 (Attorney Docket No. CISCP131), filed on January 24, 2000, and U.S. 
Patent Application Serial No. 09/606,503 (Attorney Docket No. CISCP145), filed June 
28, 2000, which claims priority under 35 USC 119(e) from U.S. Provisional Patent 
Application Serial No. 60/159,085 (Attorney Docket No. CISCP131P), filed on October 
13, 1999. The present application is also related to U.S. Patent Application Serial Nos. 

(Attorney Docket No. CISCP230), filed concurrently herewith, naming 

Chapman, et. al., as inventors. Each of these applications is incorporated herein by 
reference in its entirety for all purposes. 

BACKGROUND OF THE INVENTION 

This invention relates to digital computer network technology. More 
specifically, the present invention relates a new fiber node configuration to be 
implemented in cable networks. 

Broadband access technologies such as cable, fiber optic, and wireless have 
made rapid progress in recent years. Recently there has been a convergence of voice 
and data networks which is due in part to US deregulation of the telecommunications 
industry. In order to stay competitive, companies offering broadband access 
technologies need to support voice, video, and other high-bandwidth applications over 
their local access networks. For networks that use a shared access medium to 
communicate between subscribers and the service provider (e.g., cable networks, 
wireless networks, etc.), providing reliable high-quality voice/video communication 
over such networks is not an easy task. 

One type of broadband access technology relates to cable modem networks. A 
cable modem network or "cable plant" employs cable modems, which are an 
improvement of conventional PC data modems and provide high speed connectivity. 
Cable modems are therefore instrumental in transforming the cable system into a full 
service provider of video, voice and data telecommunications services. Digital data on 
upstream and downstream channels of the cable network is carried over radio frequency 
("RF") carrier signals. Cable modems convert digital data to a modulated RF signal for 
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upstream transmission and convert downstream RF signal to digital form. The 
conversion is done at a subscriber's facility. At a Cable Modem Termination System 
("CMTS"), located at a Head End of the cable network, the conversions are reversed. 
The CMTS converts downstream digital data to a modulated RF signal, which is carried 
5 over the fiber and coaxial lines to the subscriber premises. The cable modem then 
demodulates the RF signal and feeds the digital data to a computer. On the return path, 
the digital data is fed to the cable modem (from an associated PC for example), which 
converts it to a modulated RF signal. Once the CMTS receives the upstream RF signal, 
it demodulates it and transmits the digital data to an external source. 
10 FIGURE 1 shows a block diagram of a conventional cable network 100. The 

cable network 100 includes a Head End 102 which provides a communication interface 
between nodes (e.g. cable modems) in the cable network and external networks such as, 
for example, the Internet. The cable modems typically reside at the subscriber premises 
llOa-d. 

15 The Head End 102 is typically connected to one or more hubs 104. Each hub is 

configured to service one or more fiber nodes 106 in the cable network. Each fiber 
node is, in turn, configured to service one or more subscriber groups 110. Each 
subscriber group typically comprises about 500 to 2000 households. A primary 
function of the fiber nodes 106 is to provide an optical-electronic signal interface 

20 between the Head End 102 and the plurality of cable modems residing at the plurality of 
subscriber groups 110. 

Communication between the Head End 102, hub 104, and fiber node 106a is 
typically implemented using modulated optical signals which travel over fiber optic 
cables. More specifically, during the transmission of modulated optical signals, 

25 multiple optical frequencies are modulated with data and transmitted over optical fibers 
such as, for example, optical fiber links 103 and 105a,b of FIGURE 1, which are 
typically referred to as "RF fibers". 

As shown in FIGURE 1, the modulated optical signals transmitted from the 
Head End 102 eventually terminate at the fiber node 106a. The fiber nodes maintain the 

30 RF modulation while converting from the fiber media to the coax media and back. 

FIGURE 2 shows a block diagram of a conventional fiber node 200 such as, for 
example, fiber node 106a of FIGURE 1. In conventional cable networks, the fiber node 
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200 is responsible for converting RF modulated wavelength optical signals into 
electrical signals and vice versa. The RF modulated optical signals enter the fiber node 
200 via downstream RF fiber 205, and are converted into electric signals by the optical- 
to-electric signal converter 202. The electrical signals are then amplified by 
5 downstream amplifier 204. The amplified electric signals are then passed to a diplexor 
210 which transmits the electric signals over the coaxial line 209 to the plurality of 
cable modems. 

In the reverse direction, the cable modems transmit electrical signals via the 
coaxial line 209 to the fiber node 200. The upstream electrical signals from the cable 

10 modems are received at the diplexor 210, and passed to the upstream amplifier 206. The 
upstream electrical signals are then passed from the amplifier 206 to an electric-to- 
optical signal converter, which converts the upstream electric signals into radio 
frequency wavelength modulated optical signals which are then transmitted to the Head 
End via upstream RF fiber 207. 

1 5 Typically, the use of RF modulated optical signals in the cable network 100 only 

allows for very narrow opportunities to transmit IP packets. This is because most of the 
bandwidth of the RF modulated optical signal is used for DOCSIS related signaling 
between the Head End 102 and plurality of cable modems. 

As a result, most conventional cable networks are not equipped to handle 

20 increased data flows relating to new and emerging broadband network applications such 
as video-on-demand, telephony, etc. Accordingly, there exists a continual need to 
improve access network configurations in order to accommodate new and emerging 
network applications and technologies. 

SUMMARY OF THE INVENTION 

25 

According to different embodiments of the present invention, at least one 
packet fiber node may be provided for use in an access network such as, for example, a 
cable network. The packet fiber node may differ from convention RF fiber nodes 
deployed in a cable network in that the packet fiber node is configured to communicate 
30 with the Head End of the network using baseband optical signals rather than frequency 
modulated optical signals. 
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According to a specific embodiment of the present invention, a packet fiber 
node may include at least one processor, memory, a first interface for communicating 
with the Head End of the access network, and a second interface for communicating 
with at least a portion of network nodes. In embodiments where the access network 
5 corresponds to a cable network, the network nodes will correspond to cable modems. 
The packet fiber node is configured to communicate with the Head End using baseband 
optical signals, and is further configured to communicate with at least a portion of the 
network nodes using modulated electrical signals. In accordance with specific 
embodiments of the present invention, one or more packet fiber nodes may be deployed 

10 in a cable network to service a plurality of subscriber groups which are serviced by a 
single, conventional RF fiber node. 

An alternate embodiment of the present invention is directed to a packet fiber 
node which comprises a diplexor, at least one interface, and a distributed cable modem 
termination system (DCMTS). The packet fiber node may be configured to 

15 communicate with the Head End using baseband optical signals. Additionally, the 
packet fiber node may be configured to not include componentry for communicating 
with the Head End using frequency modulated optical signals. According to a specific 
embodiment, the packet fiber node may be configured to perform functions relating to 
DOCSIS MAC scheduling operations and/or functions relating to layer 1 and layer 2 

20 protocols. 

Another embodiment of the present invention is directed to a method for 
performing communication in a cable network. The cable network includes a Head End 
which communicates with a plurality of different cable modem groups using at least 
one upstream channel and at least one downstream channel. Spatial reuse of the 

25 upstream and/or downstream channel frequencies may be implemented using at least 
one packet fiber node. According to a specific embodiment, the same channel 
frequency may be used to communicate with at least 2 different cable modem groups 
which are serviced by a common RF fiber node. 

Additional objects, features and advantages of the various aspects of the present 

30 invention will become apparent from the following description of its preferred 
embodiments, which description should be taken in conjunction with the accompanying 
drawings. 



ATTY DKT: CISCP221 



6 



RRTEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 shows a block diagram of a conventional cable network 100. 

FIGURE 2 shows a block diagram of a conventional fiber node 200 such as, for 
example, fiber node 106a of FIGURE 1. 

FIGURE 3A shows a specific embodiment of a modified cable network 300. 

FIGURE 3B shows an alternate embodiment of a modified cable network 350. 

FIGURE 4 shows the specific embodiment of a modified fiber node 400. 

FIGURE 5 shows a block diagram of a cable network 500 in accordance with a 
specific embodiment of the present invention. 

FIGURE 6 shows a block diagram of a packet fiber node 600 in accordance with 
a specific embodiment of the present invention. 

FIGURE 7 provides an example of a DCMTS system 700 which may be used to 
implement certain aspects of this invention. 

FIGURE 8 shows a block diagram of a specific embodiment of a Cable Modem 
Termination System (CMTS) 800 which may be used to implement certain aspects of 
the present invention. 

FIGURE 9 shows an alternate embodiment of a cable network 950 which may 
be used for implementing various aspects of the present invention. 

DETAILED DESCRIPTION 

As the number of cable network subscribers increases, increased bandwidth 
demands are continuously being placed upon the cable network. In order to 
accommodate these increased demands in bandwidth, continual efforts are undertaken 
to increase bandwidth availability in the network, preferably by utilizing existing 
infrastructure. 

According to different embodiments of the present invention, a plurality of 
different techniques are described for providing increased bandwidth availability to 
selected nodes in an access network. For example, according to one implementation, a 
baseband packet-over-fiber communication system may be implemented for providing 
increased data bandwidth and link budget to network nodes. 
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As commonly known to one having ordinary skill in the art, baseband optical 
signals may be transmitted over an optical fiber at a higher frequency than RF 
modulated optical signals. As a result, the available bandwidth of an optical fiber 
carrying baseband optical signals may be significantly greater than the available 
5 bandwidth of RF modulated optical signals traveling over the same optical fiber. Thus, 
one solution for increasing available bandwidth in the cable network is to modify 
conventinal RF modulated optical communication equipment to include additional 
equipment for performing baseband optical communication. 

However, this approach is undesirable since a substantial amount of 
10 infrastructure supporting RF modulated optical signals has already been installed in 
most conventional cable networks. Such infrastructure may generally be referred to as 
legacy RF cable network componentry. Thus, rather than converting all existing cable 
network infrastructure from RF fiber to baseband fiber, a preferred approach for 
increasing bandwidth availability in the cable network is to implement a solution which 
15 is compatible with the legacy RF cable network components. 

Currently, extensive research is being conducted for arriving at a preferred 
technique for intergrating baseband optical communication with broadband (e.g. RF 
modulated) optical communication in a single fiber node which is also configured to 
support (1) legacy RF downstreams, (2) legacy RF upstreams (3) packet baseband 
20 downstream communication, and (4) packet baseband upstream communication. One 
such technique is shown in FIGURE 3 A of the drawings. 

FIGURE 3A shows a specific embodiment of a modified cable network 300. In 
the example of FIGURE 3A, the cable network 300 has been configured to enable 
baseband optical signal communication between the Head End 302 and the plurality of 
25 fiber nodes 306, in addition to conventional broadband communication. Thus, the cable 
network 300 is configured to support both RF modulated optical signals and baseband 
optical signals. The technique for communicating via baseband optical signals is 
generally known to one having ordinary skill in the art, and is described, for example, in 
the reference, "Modern Cable Television Technology," by James Farmer, David Large, 
30 Walter S. Ciciora, Morgan Kaufman Publishers, Inc., 1999, ISBN: 1558604162, herein 
incorporated by reference in its entirety for all purposes. 
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As shown in FIGURE 3A, the Head End 302 and hub 304 have each been 
modified to support communication via RF fiber 303 and baseband fiber 305. 
Additionally, as shown in FIGURE 3 A, each conventional fiber node has been modified 
to include additional componentry for supporting baseband optical signal 
5 communication. An example of the modified fiber node 306a is shown in FIGURE 4 of 
the drawings. 

FIGURE 4 shows the specific embodiment of a modified fiber node 400. In 
addition to the conventional fiber node components (402, 404, 406, 408, 410) which 
provide RF modulated optical signal functionality for interfacing RF fiber with coaxial 

10 cable, the modified fiber node 400 also includes additional circuitry for providing 
broadband optical signal communication functionality used for interfacing broadband 
fiber with conventional coaxial cable. As show in the example of FIGURE 4, the 
baseband componentry includes a distribured CMTS (DCMTS) 430, up converter 416, 
signal combiner 412, and signal splitter 414. 

15 According to a specific embodiment, the functionality of the DCMTS may 

include all or a portion of the functionality provided by a conventional CMTS, with the 
exception that the DCMTS communicates with the Head End using baseband optical 
signals. 

According to the embodiment of FIGURE 4, the DCMTS 430 is configured to 
20 receive and transmit baseband optical signals via one or more baseband fibers 411. For 
example, in one embodiment, the DCMTS may use one fiber for transmitting data, and 
another fiber for receiving data. Alternatively, a single fiber may be used for both 
receiving and transmitting. 

One advantage of including a DCMTS in a selected fiber node is that the 
25 DCMTS is able to provide additional bandwidth between the Head End 302 and that 
fiber node. Another advantage of including a DCMTS in selected fiber nodes is that the 
DCMTS may perform, at a relatively local level, at least a portion of the scheduling or 
MAC functions typically performed by the CMTS at the Head End (e.g. 302) of the 
cable network. 

30 For example, according to different embodiments, the DCMTS may be 

configured to perform downstream modulation, upstream demodulation, ranging, 
registration, generation of channel MAP messages, generation and termination of MAC 
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messages, encryption/decryption, and other functions, such as those, described, for 
example, with respect to FIGURES 7 and 8 of the drawings. 

Referring to FIGURE 4, downstream baseband optical signals are received at 
the DCMTS 430 and passed to up converter 416, where the optical signals are 
5 converted into electrical signals. The electrical signals from up converter 416 are fed to 
a combiner 412, which combines signals originating from the baseband fiber with 
signals originating from the RF fiber. The combined signals are then sent to diplexor 
410 where they are transmitted over the coaxial line 409 to the plurality of cable 
modems residing at the subscriber premises serviced by fiber node 400. As commonly 
10 known to one having ordinary skill in the art, a primary function of the diplexor 410 is 
to convert electrical signals from an intermediate frequency (within the fiber node) to a 
relatively high frequency (for transmission over the coax cable) and vice versa. 

In the reverse direction, electrical signals from the cable modems are 
transmitted via coax line 409 to the diplexor 410. The upstream signals are then passed 
15 from the diplexor 410 to the splitter 414. The splitter 414 separates the upstream 
signals, passing a first portion of the upstream signals to the DCMTS 430, and passing 
a second portion of the upstream signals to the Head End via components 406 and 408. 
According to a specific embodiment, the DCMTS 430 and CMTS (at the Head End) 
may each receive a copy of the upstream spectrum, and extract desired signals from 
20 selected portions of the upstream spectrum. 

Although modified cable network of FIGURE 3A describes one solution for 
providing increased bandwidth capacity between the Head End 302 and the plurality of 
fiber nodes 306, it does not solve the problem of providing increased bandwidth 
capacity on coaxial cable lines 309a and 309b, which provide the communication paths 
25 between the fiber nodes 306 and the plurality of subscriber groups 310. 

One solution for addressing this latter problem of providing increased 
bandwidth capacity to the plurality of subscriber groups 310 is to increase the number 
of fiber nodes servicing the plurality of subscriber groups. An example of this is shown 
in FIGURE 3B of the drawings. 
30 FIGURE 3B shows an alternate embodiment of a modified cable network 350. 

As shown in FIGURE 3B ? a different modified fiber node 356a-d is configured to 
service each respective subscriber group 310a-d. In this embodiment, the modified 
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fiber node is pushed deeper into the network, resulting in greater bandwidth availability 
on each respective coax cable line connecting a fiber node to its respective subscriber 
group(s). For example, if it is assumed that the number of cable modems serviced by 
each coaxial fiber 359a-d is half that serviced by coax cables 309a-b of FIGURE 3A, 
5 then it may be assumed that the available bandwidth on coax cable lines 359a-d has 
effectively doubled. 

One problem with the cable network configuration of FIGURE 3B is that the 
provisioning of additional, modified fiber nodes in the cable network infrastructure 
requires a significant amount of cost and overhead for implementation. One reason for 

10 this expense relates to the cost of the modified fiber node, which must be configured to 
include RF fiber componentry as well as baseband fiber componentry. 

Another drawback to the configuration of FIGURE 3B is that an independent 
manufacturer of DCMTS systems would need to install the DCMTS systems into 
conventional fiber nodes, which are typically owned by the cable network service 

1 5 provider. Moreover, in order to manufacture the modified fiber node, the independent 
DCMTS manufacturer would most likely have to partner with fiber node 
manufacturers, which may include competitors. Additionally, the cable network 
configuration of FIGURE 3B does not provide the capability for scalable, independent 
IP networks to be built on top of conventional HFC cable plants containing 

20 conventional fiber nodes. Thus, it will be appreciated that the cable network 
configuration of FIGURE 3B poses major deployment and business problems for 
independent DCMTS manufacturers and network service providers. 

Additionally, because each conventional fiber node must be modified to include 
a DCMTS and broadband fiber capabilities, deployment of the cable network 350 of 

25 FIGURE 3B may result in significant service disruptions to end users during the 
modification of the conventional cable network. 

Contrary to efforts in the cable industry to implement a modified fiber node 
which is capable of supporting both baseband and broadband fiber optic 
communication, an alternate embodiment of the present invention departs from 

30 conventional wisdom by dividing the problem, whereby two distinct types of fiber 
nodes are implemented in the cable network. This is shown, for example, in FIGURE 5 
of the drawings. 
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FIGURE 5 shows a block diagram of a cable network 500 in accordance with a 
specific embodiment of the present invention. As show in FIGURE 5, the cable 
network 500 includes two different types of fiber nodes, namely an RF fiber node 506, 
and a packet fiber node (e.g. 520a). According to a specific embodiment, the RF fiber 
5 node 506 may include componentry such as that shown, for example, in fiber node 200 
of FIGURE 2. The RF fiber node 506 may be configured to handle all legacy RF 
downstream and upstream communications, and may be configured to perform 
additional functions associated with conventional fiber nodes. 

According to the embodiment of FIGURE 5, a baseband fiber network 516 is 
10 deployed which is coupled to the conventional cable network. The baseband fiber 
network may include a plurality of packet fiber nodes 520, which are also coupled to 
the conventional fiber network. In a specific implementation, the configuration, 
functionality, and connectivity of the conventional RF fiber nodes (e.g. 506) are the 
same as those in conventional cable networks, such as that shown, for example, in 
15 FIGURE 1. However, the packet fiber nodes are pushed deeper into the network (i.e. 
closer to the subscriber groups) which, as illustrated in FIGURE 5, may result in a 
plurality of packet fiber nodes 520 servicing the subscriber groups (e.g. 510a, 510b) 
which are serviced by a single RF fiber node 506. For example, the RF fiber node 506 
may be configured to service 500 households past (HHP) while each packet fiber node 
20 may be configured to service 100 households past, resulting in 5 packet fiber nodes (not 
shown) servicing the 500 households which are serviced by the RF fiber node 506. 

FIGURE 6 shows a block diagram of a packet fiber node 600 in accordance with 
a specific embodiment of the present invention. According to a specific embodiment, 
communication with the packet fiber node 600 may be achieved using unmodulated 
25 baseband digital signals. In one implementation, communication between the Head 
End and the packet fiber node 600 may be achieved using a plurality of baseband 
optical signals which are simultaneously transmitted on different optical wavelengths 
using DWDM technology. Additionally, according to specific embodiments, the 
framing of the digital signal may be, for example, Ethernet based, digital frame 
30 structures which are based upon Ethernet, or other packet framing mechanisms. 

As shown in FIGURE 6, the packet fiber node 600 includes a DCMTS 602, an 
up converter 604, and diplexor 608. According to a specific implementation, the 
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DCMTS 602 may be configure to perform conversions between packet protocols 
implemented over the fiber media 613a, 613b and DOCSIS protocols implemented on 
the coax media 611. According to one embodiment, the packet fiber node (e.g. 520a) 
may be responsible for handling baseband communications with the Head End 502 and 
5 communications for specific DOCSIS channels which are utilized by the cable modems 
serviced by the packet fiber node. For example, the DCMTS 602 may be configured to 
handle layer 1 and layer 2 functionality such as the OSI layer management (e.g. physical 
layer, RF layer, hardware), MAC layer management, data link layer management, 
framing functionality, DOCSIS protocol functionality, etc. The RF fiber node 506 may 
10 be responsible for handling legacy RF related signals (such as, for example, set-topbox 
signals, telemetry signals, etc.) and communications which occur on centralized 
DOCSIS channels. 

As shown in FIGURE 5, each packet fiber node may be inserted into the cable 
network 500 using a combiner and/or splitter which maybe used to add and/or separate 

15 DOCSIS signals into from the RF lineup. According to a specific implementation, the 
packet fiber node may be powered from the coax media to which it is connected. 
According to alternate embodiments, the packet fiber node may also include a fiber 
transceiver or (equivalent), a combiner, a power supply, etc. In specific embodiments 
where gigabit interface converters (GBICs) are used, short or long range optics may 

20 also be selectively used, as desired. 

In the embodiment of FIGURE 5, communication between the Head End 502 
and the plurality of fiber nodes 520 may be accomplished via a baseband fiber network 
516. According to a specific implementation, one or more DP tunnels may be formed 
between the Head End 502 and the plurality of packet fiber nodes 520 in order to allow 

25 for transmission and reception of IP packets. In a specific implementation, the IP 
tunnel(s) may be formed between a CMTS 501 and a DCMTS (residing at one or more 
packet fiber nodes). The CMTS 501 may be configured to handle layer 3 functionality, 
including packet-related decisions, network layer decisions, IP related decisions, etc. 
Additionally, according to a specific implementation, the CMTS may also be 

30 responsible for handing redundancy and/or fail over functionality for selected DCMTS 
devices. 
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In addition to being configured to receive baseband optical signals, the packet 
fiber nodes 520 may also be configured to receive electrical signals from the RF fiber 
nodes via coax lines (e.g. 507 A, 507B). Such electrical signals may include, for 
example, clock or other timing reference signals and/or timestamp synchronization 
5 signals. 

One advantage of creating a separate packet fiber node 600 is that it is less 
costly and easier to implement than the modified fiber node described, for example, in 
FIGURE 4 of the drawings. Additionally, by not changing the connectivity or 
configuration of the conventional RF fiber nodes, implementation of the cable network 
10 as shown in FIGURE 5, for example, may be more cost effective and less disruptive in 
deployment than the implementation of the cable network 350 as shown in FIGURE 3B 
of the drawings. 

Another advantage of the packet fiber node implementation is that the packet 
fiber node may be used as a component for deploying fiber to the home, in the MSO 

1 5 environment. For example, a packet fiber node may initially utilize a DCMTS to push 
the IP layer deep into the network. Thereafter, the DCMTS may be removed, and the 
packet fiber node may then be used as a platform to deliver fiber directly to the home. 
Additionally, by designing a cable network to include separate packet fiber nodes as 
shown, for example, in FIGURE 5, an independent, scalable IP network may be built on 

20 top of any existing HFC network containing any manufacturer's conventional fiber 
nodes. Thus, the technique of the present invention provides a solution to the 
deployment and business issues described previously with respect to FIGURE 3B of the 
drawings. Additionally, the packet fiber node solution of the present invention provides 
MSO's with the ability to address high capacity, bandwidth, and customer needs 

25 without having to upgrade their entire HFC plants to a modified fiber node architecture 
such as that shown, for example, in FIGURE 3B of the drawings. 

An additional advantage of the packet fiber node implementation of the present 
invention as shown, for example, in FIGURE 5 is that it allows for spatial reuse of 
downstream and upstream channels from each of the fiber nodes to their respective 

30 subscriber groups. In contrast, the fiber nodes of conventional HFC networks such as 
those illustrated, for example, in FIGURE 1, are not able to spatially reuse the 
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downstream and upstream channels for communicating with different subscriber 
groups. 

By way of illustration, let us assume that CMTS 120 of FIGURE 1 
communicates with cable modems in Subscriber Group A 1 10a via fiber node 106a and 
5 coax line 107a using a first downstream channel having a frequency of 550 MHz. If 
different information is to be communicated to cable modems in Subscriber Group B 
1 10b, CMTS 120 is not able to use the 550 MHz downstream channel for this purpose 
since that channel frequency is already being used to communicate with cable modems 
in Subscriber Group A. However, referring to FIGURE 5, since the packet fiber nodes 

10 520 may be configured to include DCMTS devices which handle DOCSIS 
functionality, CMTS 501 may communicate with Packet Fiber Nodes A and B (520a, 
520b) via the baseband fiber network 516, whereupon Packet Fiber Node A may then 
communicate with cable modems in Subscriber Group A 510a via coax line 509a using 
a downstream frequency of 550 MHz (for example), and Packet Fiber Node B 520b 

15 may communicate with cable modems in Subscriber Group B 510b via coax line 509b 
using the same downstream channel frequency of 550 MHz. Thus it will be appreciated 
that the technique of the present invention allows for the spatial reuse of downstream 
and upstream channel frequencies for communicating with different subscriber groups 
which are serviced by a single RF fiber node. 

20 CMTS and DCMTS Configurations 

FIGURE 7 provides an example of a DCMTS system 700 which may be used to 
implement certain aspects of this invention. In the specific embodiment as shown in 
FIGURE 7, a DCMTS 700 provides functions on three network layers including a 
physical layer 732, a Media Access Control (MAC) layer 730, and a network layer 744. 

25 Generally, the physical layer is responsible for receiving and transmitting modulated 
signals over coax lines to the cable modems. Hardware portions of the physical layer 
include at least one downstream modulator and transmitter 706 and/or at least one 
upstream demodulator and receiver 714. The physical layer also includes software 786 
for driving the hardware components of the physical layer. 

30 Electrical upstream data signals (packets) arriving via lines 710 are demodulated 

by a receiver 714, and then passed to MAC layer block 730. A primary purpose of 
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MAC layer 730 is to encapsulate, with MAC headers, downstream packets and 
decapsulate, of MAC headers, upstream packets. In one embodiment, the encapsulation 
and decapsulation proceed as dictated by the above-mentioned DOCSIS standard for 
transmission of data or other information. The MAC headers include addresses to 
5 specific modems (if sent downstream) or to the CMTS (if sent upstream) by a MAC 
layer block 730 in DCMTS 700. Note that the cable modems also include MAC 
addressing components. In the cable modems, these components encapsulate upstream 
data with a header containing the MAC address of the DCMTS and/or CMTS. 

MAC layer block 730 includes a MAC layer hardware portion and a MAC layer 

10 software portion. The MAC layer hardware portion includes a MAC controller 734, 
and may also include a processor 735. According to a specific implementation, the 
processor 735 may be configure to perform functions relating to MAP routing, load 
balancing, etc. The MAC layer software portion may include software relating to 
DOCSIS MAC functionality 784, MAP routing functionality 783 (if desired), load 

15 balancing functionality 785 (if desired), etc. The MAC layer hardware and software 
portions operate together to provide the above-described functionality. In a preferred 
embodiment, MAC hardware portion 734 is distinct from a general-purpose 
microprocessor 755, and is dedicated to performing some MAC layer functions. 

In specific DCMTS configurations, the hardware portions of the physical layer 

20 732 and MAC layer 730 reside on physical line cards 720 within the DCMTS. The 
DCMTS may include a plurality of distinct line cards which service particular cable 
modems in the network. Each line card may be configured to have its own unique 
hardware portions of the physical layer 732 and MAC layer 730. 

After MAC layer block 730 has processed the upstream information, it is then 

25 passed to network layer block 744. According to a specific implementation, the 
network layer block 744 includes tunneling software 782 for causing the upstream 
information packet to be tunneled to via the optical fiber interface 702 to the CMTS. 
According to an alternate embodiment, the DCMTS may be configured to communicate 
with the Head End and other DCMTS devices via a standardized IP protocol. 

30 According to a specific embodiment, the optical fiber interface 702 may also 

include a laser and optical-electrical signal conversion componentry for converting 
optical signal into electrical signals and vice-versa. In the specific embodiment of 
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FIGURE 7, the optical fiber interface 702 is configured to communicate with a CMTS 
(not shown) via baseband optical fibers 703. 

When a packet is received at the optical fiber interface 702 from the CMTS, the 
network layer 744 passes the packet to MAC layer 730. MAC block 700 then transmits 

5 information via a one-way communication medium to downstream modulator and 
transmitter 706. Downstream modulator and transmitter 706 takes the data (or other 
information) in a packet structure and converts it to modulated downstream frames, 
such as MPEG or ATM frames, on the downstream carrier using, for example, QAM64 
modulation. Other methods of modulation may also be used such as, for example, 

10 QAM256 modulation, CDMA (Code Division Multiple Access), OFDM (Orthogonal 
Frequency Division Multiplexing), FSK (FREQ Shift Keying), etc. The return data is 
likewise modulated using, for example, QAM16 or QSPK. According to a specific 
embodiment, the modulated data is converted from IF electrical signals to RF electrical 
signals (or vice-versa) using one or more electrical signal converters (not shown). 

15 Note that alternate embodiments of the DCMTS (not shown) may not include 

network layer 744. In such embodiments, a DCMTS device may include only a 
physical layer and a MAC layer, which are responsible for modifying a packet 
according to the appropriate standard for transmission of information over a cable 
modem network. The network layer 744 of these alternate embodiments of DCMTS 

20 devices may be included, for example, as part of a conventional router for a packet- 
switched network. In a specific embodiment, the network layer of the DCMTS is 
configured as a line card coupled to a standard router that includes the physical layer 
block 732 and MAC layer block 730. Using this type of configuration, the DCMTS is 
able to send and/or receive IP packets to and from the optical fiber interface 702 using 

25 tunneling software block 782. According to an alternate embodiment, the DCMTS may 
be configured to include all or a selected portion of the functionality implemented at a 
conventional CMTS. In this latter embodiment, the DCMTS devices may be 
configured to handle conventional CMTS functionality, and may be aggregated via a 
router or switch at the Head End (illustrated, for example, in FIGURE 9). 

30 As shown in FIGURE 7, DCMTS 700 includes a central hardware block 750 

including one or more processors 755 and memory 757. These hardware components 
interact with software and other hardware portions of the various layers within the 
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DCMTS. They provide general purpose computing power for much of the software. 
Memory 757 may include, for example, I/O memory (e.g. buffers), program memory, 
shared memory, etc. One or more data structures used for implementing the technique 
of the present invention may reside in such memory. Hardware block 750 may 
5 physically reside with the other DCMTS components. In one embodiment, the software 
entities 782, 784, and 786 are implemented as part of a network operating system 
running on hardware 750. According to a specific implementation, at least a part of the 
packet fiber node functionality of this invention are implemented in software as part of 
the operating system. Li FIGURE 7, such software may be part of MAC layer software 

10 784 and/or the tunneling software 782, or may be closely associated therewith. Of 
course, the packet fiber node logic of the present invention could reside in hardware, 
software, or some combination of the two. 

According to a specific embodiment, the procedures employed by the DCMTS 
during registration and pre-registration are performed at the MAC layer of the DCMTS 

15 logic. Thus, in DCMTS 700, most of the registration operations would be performed 
by the hardware and software provided for MAC layer logic 730. Additionally, the 
operations associated with obtaining an IP address for cable modems may be 
implemented at the network layer level 744, 

In a specific embodiment, the DCMTS systems of this invention may be 

20 specially configured CMTSs or routers such as, for example, specially configured 
models in the uBR-7200 series and uBR-10012 series of CMTSs available from Cisco 
Systems, Inc. of San Jose, California. In an alternative embodiment, the the invention 
may be implemented on a general-purpose network host machine such as a personal 
computer or workstation. Further, the invention may be at least partially implemented 

25 on a card (e.g., an interface card) for a network device or a general-purpose computing 
device. 

Although the system shown in FIGURE 7 represents one specific DCMTS 
architecture of the present invention, it is by no means the only DCMTS architecture on 
which the present invention can be implemented. For example, other types of interfaces 
30 and media could also be used with the DCMTS. 

Regardless of network device's configuration (for cable plants or otherwise), it 
may employ one or more memories or memory modules (e.g., memory 757) configured 
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to store program instructions for the network operations and other functions of the 
present invention described herein. The program instructions may specify an operating 
system and one or more applications, for example. Such memory or memories may 
also be configured to store data structures or other specific non-program information 
5 described herein. 

FIGURE 8 shows a block diagram of a specific embodiment of a Cable Modem 
Termination System (CMTS) 800 which may be used to implement certain aspects of 
the present invention. According to specific embodiments, all or selected portions of 
the functionality of the CMTS 800 of FIGURE 8 maybe implemented at the distributed 

10 CMTS 602 of FIGURE 6. 

As shown in FIGURE 8, the CMTS 800 may comprise a plurality of routing 
engines (e.g. 801a, 801b). In a specific implementation, Routing Engine A 801a may be 
configured as a primary or working routing engine, while Routing Engine B 801b may 
be configured as a backup or standby routing engine which provides redundancy 

15 functionality. 

As shown in the embodiment of FIGURE 8, each of the routing engines may 
include a variety of similar modules and/or components. In order to avoid confusion, 
the various components and/or modules relating to Routing Engine A 801a will now be 
described in greater detail with the understanding that such descriptions may also be 

20 applied to the corresponding components and modules of Routing Engine B 801b. 

According to a specific embodiment, Routing Engine A may be configured or 
designed to include a plurality of functionally different modules or components, 
including, for example, a Forwarding Processor (FP) Module 811a adapted to provide 
packet forwarding functionality; a Route Processor (RP) Module 803a adapted to 

25 implement routing or forwarding operations; a utility component 802a adapted to 
provide system clock and timestamp functionality; etc. The routing engine components 
provide may be configured to provide layer one, layer two, layer three and layer four 
functionality as well as quality of service (QoS) functionality. 

According to a specific implementation, the RP Module 803a may be 

30 configured as a processor-based routing system comprising functionality incorporated 
within a typical router, such as, for example, specially configured router models 1600, 
2500, 2600, 3600, 4500, 4700, 7200, 7500, 10012, and 12000 available from Cisco 
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Systems, Inc. of San Jose, California. For example, as shown in the embodiment of 
FIGURE 8, the RP Module 803a comprises a general-purpose processor 805a (e.g., a 
MIPS route processor) coupled to a system controller 809a and memory 807a. It should 
be noted that components have been described in singular form for clarity. One skilled 
5 in the art would appreciate that multiple processors, a variety of memory formats, or 
multiple system controllers, for example, can be used in this context as well as in other 
contexts while falling within the scope of the present invention. The memory 807a may 
comprise synchronous dynamic random access memory (SDRAM) storage locations 
addressable by the processor 805a for storing software programs and data structures 
10 accessed by the components. A network routing operating system, portions of which 
may reside in memory and executed by the route processor, functionally organizes the 
router by invoking network operations in support of software processes executing on 
the router. 

The RP processor 805a may be configured to construct and load routing tables 

15 used by the FP Module 811a. The processor 805a may also be configured or designed 
to perform configuration management functions of the routing engine 801a, and to 
communicate with neighboring peer, standby, and/or backup routers to exchange 
protocol data units used to construct the routing tables in accordance with conventional 
routing algorithms. It will be apparent to those skilled in the art that other memory 

20 types, including various computer readable media, may be used for storing and 
executing program instructions pertaining to the operation of the routing engine. 

Interface circuitry 827a may be coupled to the respective interface circuitry 
833a, 833b of line cards 831a, 831b. According to a specific implementation, interface 
circuitry 827a may be configured to reside on a backplane logic circuit 823a of the 

25 routing engine. In one example, the backplane logic circuit 823a is embodied as a high 
performance, application specific integrated circuit (ASIC). An example of a backplane 
logic circuit that may be advantageously used with the present invention is disclosed in 
co-pending and commonly owned U.S. Patent Application Serial No. 09/791,063, filed 
on February 22, 2001, the entirety of which is hereby incorporated by reference for all 

30 purposes. 

According to a specific embodiment, the backplane logic circuit (which, 
according to a specific implementation, may be configured as an ASIC), may be 
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configured to further interface the line cards to a packet buffer 825a and a forwarding 
engine 821a of the FP Module 811a. The packet buffer 825a may include memory 
which is configured to store packets as the forwarding engine 821a performs its packet 
forwarding functions. For example, the packet buffer may be used to store low priority 
5 data packets while high priority, low latency voice packets are forwarded by the 
forwarding engine to a data network interface 835 a. According to various 
embodiments, the FP Module 81 1 may comprise a processor 813a and memory 815a for 
handling transport layer 817 and network layer 819 functionality. In one 
implementation, the processor 813a may be configured to track accounting, port, and 

10 billing information for various users on a cable modem network 851. The processor 
813a may also be configured to maintain desired service flow or session state 
information in memory 815a such as, for example, for voice calls initiated over the 
cable modem network. The FP Module 811a may also be configured to provide 
transaction compacting functionality, data parcel tunneling functionality, switching 

1 5 functionality, and other functionality described herein. 

According to a specific implementation, Routing Engine A 801a may be 
connected to Routing Engine B 801b via at least one link 846, such as, for example, a 
backplane line or system bus. Routing engine redundancy may be provided by 
designating one of the routing engines as the working or primary routing engine and 

20 designating the other routing engine(s) as the redundant or standby routing engine(s). 
When configured as a working routing engine, the Routing Engine A may perform all 
appropriate forwarding and routing functions. When a failure occurs at the working 
routing engine, the redundant routing engine (e.g. Routing Engine B) may then take 
over the operations of the working routing engine. Thereafter, when Routing Engine A 

25 recovers, it may assume the functions of the redundant routing engine, or it may take 
over the functions of the working routing engine. 

According to different embodiments of the present invention, one or more of the 
routing engines may be configured to communicate with a plurality of line cards (e.g. 
831, 835) via point-to-point links. For example, as shown in FIGURE 8, each of the 

30 plurality of line cards 831 and 835 are connected to each of the routing engines 801a, 
801b via point-to-point links 841 and 843. One advantage of the point-to-point link 
configuration is that it provides additional reliability in that the failure of one or more 
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line cards will not interfere with communications between other line cards and the 
routing engine(s). For example, if Line Card A 831a suddenly failed, each of the 
routing engines would still be able to communicate with the other line cards. 

According to a specific embodiment, the plurality of line cards may include 
5 different types of line cards which have been specifically configured to perform specific 
functions. For example, Line Card A 831a may correspond to radio-frequency (RF) 
line card which has been configured or designed to transmit and receive RF modulated 
optical signals. Line Card B 831b may correspond to baseband line card which has been 
configured or designed to transmit and receive baseband optical signals. Additionally, 

10 line cards 835 may correspond to network interface cards which have been configured 
or designed to interface with different types of external networks (e.g. WANs, LANs,) 
utilizing different types of communication protocols (e.g. Ethernet, Frame Relay, ATM, 
TCP/IP, etc). For example, the data network interface 835a functions as an interface 
component between external data sources and the cable system. The external data 

15 sources transmit data to the data network interface 835a via, for example, optical fiber, 
microwave link, satellite link, or through various media. A data network interface may 
include hardware and software for interfacing to various networks. According to 
various embodiments, a data network interface may be implemented on a line card as 
part of a conventional router for a packet-switched network. Using this type of 

20 configuration, the CMTS is able to send and/or receive IP packets to and from the data 
network interface using, for example, network layer software 819a. 

According to a specific implementation, the operations associated with 
obtaining an IP address for cable modems may be implemented by the network layer 
software. This may involve the CM communicating with a DHCP server (not shown) 

25 via a data network interface, for example. 

As shown in FIGURE 8, at least a portion of the line cards includes interface 
circuitry for providing an appropriate interface between the host line card, other line 
cards, and/or the routing engine(s). For example, interface circuitry 833a may include 
interconnect ports coupled to one or more of the point-to-point links 841, 843. 

30 According to a specific implementation, the interface circuitry functions as a translator 
that converts conventional formats of data received at the line cards to a suitable 
protocol format for transmission from the line card to the appropriate routing engine. In 
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one implementation, the interface circuitry 833a may also include circuitry to perform 
cyclic redundancy code (CRC) generation and checking on packets, along with 
interconnect format checking. 

According to a specific embodiment, the point-to-point links 841, 843 may be 
5 configured as clock forwarded links such that each point-to-point link comprises at least 
one data wire for transporting data signals and at least one clock wire for carrying clock 
signals. However, it will be understood to those skilled in the art that the clock 
forwarding technique may be scaled to accommodate other clock forwarding 
arrangements such as, for example, connections comprising a plurality or data signals 
10 and/or clock signals. Additionally, according to a specific embodiment, each line card 
may be configured to provide at least one communication interface between the routing 
engines (801a, 801b) and a portion of the cable network. The data network interface 
835a may couple the routing engine 801a to an external data network 855 such as, for 
example, the Internet. 

15 According to one embodiment, all or selected lines cards, routing engines and/or 

data network interfaces may be configured to use at least one common dedicated line or 
backplane (e.g. 845). According to other embodiments, the routing engines 801a, 801b 
may have an additional dedicated connection(s) for supporting redundancy. In a 
specific implementation, the backplane may be configured as an Ethernet medium that 

20 is shared by the CMTS. When the line cards are inserted into the backplane, they 
communicate with the routing engines over the lines 845 in accordance with a 
"capabilities" exchange that identifies the types of line cards and their various 
characteristics/parameters. 

According to a specific implementation, during initialization of the CMTS, the 

25 routing engines 801a and 801b negotiate for working routing engine status over the 
backplane. Assertion of working status causes the line cards 831 to configure their 
respective interface circuitry to communicate with the designated working routing 
engine (e.g. Routing Engine A 801a). The Routing Engine A 801a then configures the 
CMTS and line cards, establishes routing relationships, and initiates traffic forwarding 

30 operations. The redundant routing engine 801b may complete a self-test and perform 
initialization of its various functions. The two routing engine assemblies may then 
exchange conventional negotiation messages (which may include, for example, health 
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and status messages) via the backplane lines 845. According to a specific 
implementation, the exchanged messages are defined by an Enhanced High System 
Availability (EHSA) negotiation algorithm available from Cisco Systems, Inc. of San 
Jose, California. The redundant routing engine may also request transaction 
5 information from the working routing engine. 

When the redundant routing engine 801b detects that the primary routing engine 
has failed, the redundant routing engine may take over as the new working routing 
engine, and initiate a "cutover" operation to thereby cause the line card interface 
circuitry (e.g. 833a, 833b) to identify and communicate with the new working routing 
10 engine 801b. The new working routing engine 801b may then access and retrieve state 
information (such as, for example, telephone call state information, service flow state 
information, etc.) stored on selected line cards in order to maintain existing service 
flows. 

Prior to a failure situation, the redundant routing engine 801b may be configured 
15 to monitor the status of the working routing engine 801a, and may further be configured 
or designed to receive updated configuration, transaction and/or state information, 
which may then be stored in an appropriate location in the redundant routing engine 
801b. 

The line cards may further comprise circuitry for "looping" packets back onto 
20 the redundant routing engine 801b over the point-to-point links. This allows the 
redundant routing engine 801b to send and receive test packets to evaluate its own 
operation in addition to the operation of the dedicated lines prior to the occurrence of a 
system failure. 

Although the system shown in FIGURE 8 represents one specific CMTS 
25 architecture of the present invention, it is by no means the only CMTS architecture on 
which the present invention can be implemented. For example, other types of interfaces 
and media could also be used with the CMTS. According to different embodiments, the 
CMTS system of the present invention may be implemented as a "routing" CMTS 
which handles at least some routing functions. Alternatively, the CMTS may be a 
30 "bridging" CMTS which handles only lower-level tasks. 

Regardless of the network device's configuration (for cable plants or otherwise), 
it may employ one or more memories or memory modules (e.g., memory 807a, 815a, 
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etc.) configured to store program instructions for the network operations and other 
functions of the present invention described herein. The program instructions may 
specify an operating system and one or more applications, for example. Such memory 
or memories may also be configured to store data structures, or other specific non- 
5 program information described herein. 

Because such information and program instructions may be employed to 
implement the systems/methods described herein, the present invention relates to 
machine-readable media that include program instructions, state information, etc. for 
performing various operations described herein. Examples of machine-readable media 

10 include, but are not limited to, magnetic media such as hard disks, floppy disks, and 
magnetic tape; optical media such as CD-ROM disks; magneto-optical media such as 
floptical disks; and hardware devices that are specially configured to store and perform 
program instructions, such as read-only memory devices (ROM) and random access 
memory (RAM). Aspects of the invention may also be embodied in a carrier wave 

15 travelling over an appropriate medium such as airwaves, optical lines, electric lines, etc. 
Examples of program instructions include both machine code, such as produced by a 
compiler, and files containing higher level code that may be executed by the computer 
using an interpreter. 

It will be appreciated that, according to specific embodiments, the packet fiber 
20 node of the present invention may be implemented in a variety of different cable 
network configurations. For example, according to one embodiment, as shown, for 
example, in FIGURE 9, the cable network may include a Head End complex which 
comprises various components and/or systems such as, for example, a Head End, a 
super Head End, a hub, a primary hub, a second hub, etc. 
25 Further, it will be appreciated that, according to a specific embodiments, at least 

a portion of functions described herein which are performed by the DCMTS (e.g. 
FIGURE 7), CMTS (e.g. FIGURE 8), or selected components thereof, may be 
implemented in a centralized CMTS system (e.g. residing the Head End of the cable 
network, as shown, for example, in FIGURE 5), and/or may be implemented at one or 
30 more distributed CMTS (DCMTS) systems (e.g. residing at one or more fiber nodes, as 
shown, for example, in FIGURE 9). 
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Other Embodiments 

FIGURE 9 shows an alternate embodiment of a cable network 950 which may 
be used for implementing various aspects of the present invention. In the cable network 
of FIGURE 9, the centralized CMTS typically residing at the Head End complex 952 
5 has been removed, and its functionality incorporated into selected DCMTS devices 
residing in the packet fiber nodes 925. Thus, according to the embodiment of FIGURE 
9, selected DCMTS devices residing in the packet fiber nodes 925 may be configured to 
implement the functions typically implemented by the centralized CMTS device, such 
as, for example, layer 3 functionality and/or at least a portion of the functionality 
10 performed by the various logic described with respect to FIGURES 7 and 8 of the 
drawings. 

According to a specific embodiment, communication of IP packets between the 
Head End complex 952 and the plurality of packet fiber nodes 955 may be 
accomplished without the use of a tunneling protocol. In such an embodiment, 

1 5 communication between network devices may be accomplished using, for example, a 
standardized IP protocol. Additionally, as shown in the embodiment of FIGURE 9, the 
Head End complex 952 may include a switch 954 (e.g. Ethernet switch), or other type 
of traffic handling device which may be configured to route or forward traffic between 
network devices in the cable network 950, or between the devices in the cable network 

20 and devices in external networks. Further, as shown in the example of FIGURE 9, the 
Head End complex may also include a DCMTS Synchronization Module 955 which 
may be configured to provide synchronized clock reference signals and/or synchronized 
timestamp information to the plurality of packet fiber nodes 925. 

It will be appreciated by one having ordinary skill in the art that the technique of 

25 the present invention may be implemented in any computer network having a 
standardized protocol for utilizing a central termination system (e.g. Head End) to 
schedule timeslots for remote stations or nodes on a return (or upstream) channel. In 
wireless networks, the central termination system may be referred to as a Head End or 
wireless base station. In satellite networks, the central termination system may be 

30 referred to as a master controlling station. 

Although several preferred embodiments of this invention have been described 
in detail herein with reference to the accompanying drawings, it is to be understood that 
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the invention is not limited to these precise embodiments, and that various changes and 
modifications may be effected therein by one skilled in the art without departing from 
the scope of spirit of the invention as defined in the appended claims. 
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